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Description 

BACKGROUND OF THE INVENTION 
1 . Field of the Invention s 



[0001 ] The present invention relates to the field of net- 
works, and more particularly, to browser based net- 
works for controlling devices. 



2. Description of Related Art 
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[0002] A typical household contains several home de- 
vices. As used in this document, the term "home device" 
encompasses all electronic devices that are typically is 
found in the home, with the exception of general pur- 
pose computers (i.e. personal computers (PCs), laptop 
computers, etc). For example, the term home device in- 
cludes but is not limited to such electronic devices as 
security systems, theatre equipment (e.g., TVs, VCRs, 20 
stereo equipment, and direct broadcast satellite servic- 
es or (DBSS), also known as digital satellite sen/ices 
(DSS)), sprinkler systems, lighting systems, micro 
waves, dish washers, ovens/stoves, and washers/dry- 
ers. Indeed, an automobile may be a home device. On 25 
the other hand, the term "device" as used in this docu- 
ment may comprise logical devices or other units having 
functionality and an ability to exchange data, and may 
include not only all home devices but also general pur- 
pose computers. 30 

[0003] In general, home devices are used to perform 
tasks that enhance a homeowner's life style and stand- 
ard of living. For example, a dishwasher performs the 
task of washing dirty dishes and relieves the homeown- 
er of having to wash the dishes by hand. A VCR can 35 
record a TV program to allow a homeowner to watch a 
particular program at a later time. Security systems pro- 
tect the homeowner's valuables and can reduce the 
homeowner's fear of unwanted entry. 

[0004] Home devices (such as home theatre equip- 40 
ment) are often controlled using a single common con- 
trol unit, namely a remote control device. This single 
common control unit allows a homeownerto control and 
command several different home devices using a single 
interface. Thus, many manufacturers have developed 45 
control units for controlling and commanding their home 
devices from a single interface. 

[0005] One drawback associated with using the re- 
mote control unit to command and control home devices 
is that it provides static control and command logic for so 
controlling and commanding each home device. There- 
fore, a particular remote control un it can only control and 
command those home devices for which it includes the 
necessary control and command logic. For example, if 
a remote control unit comprises logic for controlling a ss 
television (TV), a video cassette recorder (VCR), and a 
digital video device (DVD), but not a compact disk (CD) 
unit, the remote control unit can not be used to com- 



mand and control the CD unit. In addition, as new home 
devices are developed, the remote control unit will not 
be able to control and command the new home devices 
that require control and command logic that was not 
known at the time the remote control unit was devel- 
oped. 

[0006] Another drawback associated with using a re- 
mote control unit is that it can typically only be used to 
command and control those home devices that are with- 
in the signal range of the remote control unit. Therefore, 
a user can not use the remote control unit from a single 
location in the house to control and command home de- 
vices that are connected, but located in separate parts 
of the home. For example, a VCRthat is located upstairs 
in a bedroom may be connected with a TV that is down- 
stairs in the family room. If a user wishes to play a tape 
contained in the VCR located upstairs in the bedroom, 
on theTV located downstairs in the family room, the user 
can not control and command both home devices from 
a single location. 

[0007] Therefore, there is a need for a mechanism 
that dynamically provides for control and command of 
currently known home devices. Also there is a need for 
a mechanism that dynamically provides for the control 
and command of subsequently developed home device 
types. In addition, there is a need for a mechanism that 
provides for controlling and commanding, from a single 
location within the user's home, home devices that are 
connected but remotely located throughout the user's 
home. 

SUMMARY OF THE INVENTION 

[0008] It is accordingly an object of the invention to 
overcome the problems of the prior art, and to provide 
a method and apparatus for control of a plurality of de- 
vices. 

[0009] It is a more specific object of the invention to 
provide method and apparatus for using a single control 
apparatus, with a single mode of operation, for control- 
ling a plurality of devices without requiring any change 
in the mode of operation of the control apparatus to 
change the device being controlled thereby. 

[0010] It is still a further object of the invention to pro- 
vide a home network to implement one form of a method 
and apparatus for controlling a plurality of home devices 
connected thereto by a single control apparatus without 
requiring any change in the mode of operation of the 
control apparatus (as by changing codes generated by 
pushbuttons or keys thereof) to change the device being 
controlled thereby. 

[0011] The present invention accordingly provides a 
method and system for implementing a home network 
for commanding and controlling home devices. 

[0012] In one aspect, the present invention provides 
a method for implementing command and control for de- 
vices via a network, the method comprising the steps 
of: connecting a first device to the network, wherein the 
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first device is capable of displaying user interface data; 
connecting a second device to the network, the second 
device storing user interface data in a selected format 
that defines a user interface for commanding and con- 
trolling of the second device; receiving the user interface 
data at the first device via the network from the second 
device; displaying the user interface defined by the user 
interface data on the first device; accepting user input 
from a user in response to the user interacting with the 
user interface displayed on the first device; and control- 
ling the second device by sending control and command 
information from the first device to the second device 
based on the user input. 

[0013] Suitably, said network is a home network and 
said devices are home devices. 

[0014] Suitably, the step of the second device storing 
user interface data includes the step of storing the user 
interface data as a selected interface data. 

[0015] Suitably, the step of connecting the first device 
to the network includes the step of signalling a configu- 
ration manager that the first device is connected to the 
network, wherein the configuration manager maintains 
a list of devices that are currently connected to the net- 
work. 

[0016] Suitably, the step of signalling the configura- 
tion manager that the first device is connected to the 
network includes the step of signalling a dynamic host 
configuration protocol server that the first device is con- 
nected to the network. 

[0017] Suitably, the first device performs the further 
step of accessing the list of devices maintained by the 
configuration manager. 

[0018] Suitably, the step of the second device storing 
user interface data includes the step of storing the user 
interface data as HTML data. 

[0019] Suitably, the step of connecting the first device 
to the network includes the step of connecting the first 
device to a 1394 serial bus. 

[0020] Suitably, the step of connecting the second de- 
vice to the network includes the step of connecting the 
second device to a 1394 serial bus. 

[0021 ] Suitably, the step of connecting the first device 
to the network includes the step of connecting the first 
device to an Ethernet bus. 

[0022] Suitably, the step of connecting the second de- 
vice to the network includes the step of connecting the 
second device to an Ethernet bus. 

[0023] Suitably, the step of connecting a first device 
to the network includes the step of connecting the first 
device to a first bus; and the step of connecting a second 
device to the network includes the step of connecting 
the second device to a second bus; wherein the first bus 
is connected to the second bus using a bridge proxy, 
wherein the bridge proxy provides a communication in- 
terface between the first bus and the second bus. 
[0024] Suitably, the method further comprises the 
step of connecting the network to the internet. 

[0025] Suitably, the step of displaying the user inter- 



face includes the step of displaying an HTML page as- 
sociated with the second device, wherein the HTML 
page is stored on the second device. 

[0026] Suitably, the method further comprises the 
5 step of displaying a device link page that contains a but- 
ton identifying a manufacturer of the second device, 
wherein the button is a hyperlink that provides a link to 
a page associated with the manufacturer. 

[0027] Suitably, the step of displaying the device link 
page comprises the step of accessing and displaying 
the list of devices maintained by the configuration man- 
ager. 

[0028] Suitably, the step of connecting the second de- 
vice to the network includes the step of signalling a con- 
figuration manager that the second device is connected 
to the network, wherein the configuration manager 
maintains a list of devices that are currently connected 
to the network. 

[0029] Suitably, the step of signalling the configura- 
tion manager that the second device is connected to the 
network includes the step of signalling a dynamic host 
configuration protocol server that the second device is 
connected to the network. 

[0030] Suitably, the step of the second device storing 
user interface data includes the step of storing the user 
interface data as one or more formats selected from the 
group consisting of: HTML, XML, JAVA, JAVASCRIPT, 
GIF and JPEG. 

[0031 ] Suitably, the step of connecting the first device 
to the network comprises the step of using an Internet 
Protocol (IP) and the step of connecting the second de- 
vice to the network comprises the step of using an IP. 
[0032] Suitably, the network uses a layer other than 
an IP network layer as a communication layer therefor. 
[0033] Suitably, the network uses a Function control 
Protocol (FCP) for communication. 

[0034] Suitably, the step of receiving user interface 
data at the first device over said network, includes the 
step of receiving user interface data at the first device 
over the internet; and the step of controlling the second 
device by sending control and command information in- 
cludes the step of controlling the second device by send- 
ing control and command information over the Internet. 
[0035] In another aspect, the present invention pro- 
vides a network system for commanding and controlling 
devices, the network comprising: a configuration man- 
ager; a first device containing user interface data that 
defines a user interface for commanding and controlling 
the first device; a second device having a viewable dis- 
play unit, wherein the viewable display unit displays the 
user interface for commanding and controlling the first 
device; and a physical layer, wherein the physical layer 
provides a communication medium that can be used by 
the configuration manager, the first device and the sec- 
ond device to communicate with each other. 

[0036] Suitably, said network system is a home net- 
work system. 

[0037] In a further aspect, the present invention pro- 
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vides a control system for controlling a plurality of de- 
vices comprising: remote control for controlling said plu- 
ral devices; a client device including display means for 
displaying a device selection page to a user on said dis- 
play means, said device selection page including re- 
spective display sections corresponding to each of said 
plural devices; and said remote control including com- 
municating means for communicating either with said 
client device and for providing a control command there- 
to; wherein said client device controls at least one of 
said plural devices in response to said control command 
from said remote control to cause said at least one of 
said plural devices to perform a predetermined function 
corresponding to said control command from said re- 
mote control. 

[0038] Suitably, said remote control further compris- 
ing selecting means for selecting one of said plural de- 
vices displayed in said device selection page and pro- 
viding a selection command to said client device. 
[0039] In another aspect, the present invention pro- 
vides a control system for controlling a plurality of de- 
vices comprising: remote control for controlling said plu- 
ral devices; a client device including display means for 
displaying a device selection page to a user on said dis- 
play means, said device selection page including re- 
spective display sections corresponding to each of said 
plural devices; and said remote control including com- 
municating means for communicating (alternate) with 
any one of said plural devices via said client device and 
for controlling said one of said plural devices to perform 
a predetermined function by providing a control com- 
mand corresponding thereto to said client device; 
wherein said client device receives said control com- 
mand from said remote control and in response thereto 
provides a corresponding command to said one of said 
plural devices to cause said one of said plural devices 
to perform said predetermined function. 

[0040] Suitably, said client device selects one of said 
plural devices in response to said selection command 
from said remote control and displays a GUI for said se- 
lected one of said plural devices. 

[0041] In a further aspect, the present invention pro- 
vides a control system for controlling a plurality of de- 
vices comprising: remote control for controlling said plu- 
ral devices; a client device including display means for 
displaying a device selection page to a user on said dis- 
play means, said device selection page including re- 
spective display sections corresponding to each of said 
plural devices; and said remote control including com- 
municating means for communicating with any one of 
said plural devices via said client device and for control- 
ling said one of said plural devices by providing a control 
command for controlling said client device; wherein said 
client device controls said one of said plural devices in 
response to said control command from said remote 
control to cause said at least one of said plural devices 
to perform a predetermined function corresponding to 
said control command from said remote control. 



[0042] Suitably, said client device responds to said 
control command by controlling said selected one of 
said plural devices. 

[0043] According to one aspect of the invention, a first 
5 home device that is capable of displaying user interface 
data is connected to the home network. A second home 
device that stores user interface data which defines a 
user interface for commanding and controlling the sec- 
ond home device, is also connected to the home net- 
io work. The first home device receives the user interface 
data from the second home device over the home net- 
work. The first home device then displays the user in- 
terface as defined by the user interface data. User input 
is then accepted from a user in response to the user 
15 interacting with the user interface displayed on the first 
home device. Based on the user's input, control and 
command information is sent from the first home device 
to the second home device in order to control the second 
home device. 

[0044] According to another aspect of the invention, 
the user interface data stored on the second home de- 
vice is in the form of HTML page data. 

[0045] According to another aspect of the invention, 
a configuration manager is also connected to the home 
network. When the first home device is connected to the 
home network, it signals the configuration manager that 
it is connected to the home network. The configuration 
manager maintains a list of the home devices that are 
currently connected to the home network. 

[0046] According to another aspect of the invention, 
the home network is connected to the Internet. 

[0047] According to another aspect of the invention, 
there is provided a home network system for command- 
ing and controlling home devices. The home network 
includes a configuration manager, a first home device 
that contains user interface data which defines a user 
interface for commanding and controlling the first home 
device, a second home device having a viewable dis- 
play unit that can be used to display the user interface 
for commanding and controlling the first home device, 
and an electrical bus that provides a communication me- 
dium that is used by the configuration manager, by the 
first home device and by the second home device to 
communicate with each other. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0048] The objects and features of the present inven- 
tion, which are believed to be novel, are set forth with 
particularity in the appended claims. The present inven- 
tion, both as to its organization and manner of operation, 
together with further objects and advantages, may best 
be understood by reference to the following description, 
taken in connection with the accompanying drawings, 
in which: 

FIG. 1 is a block diagram of a home network con- 
structed in accordance with the present invention; 
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FIG. 2 illustrates an example of a layered interface 
model that can be used for communicating between 
home devices in accordance with the present inven- 
tion; 

FIGS. 3A and 3B are block diagrams illustrating 5 
controlling and commanding of a home device using 
a browser based Digital TV (DTV) according to one 
embodiment of the present invention and a specific 
example; 

FIG. 4A is a block diagram illustrating a home de- 
vice discovery mechanism according to one em- 
bodiment of the invention; 

FIG. 4B depicts a flow diagram illustrating the gen- 
eration of a device list file according to certain em- 
bodiments of the invention; 

FIG. 5A is a block diagram of a device link page in 
accordance with the present invention; 

FIG. 5B illustrates an example of a home device 
tree structure according to certain embodiments of 
the invention; 

FIG. 6 graphically depicts a view of a device link 
page in accordance with the present invention; 

FIG. 7 graphically depicts an alternative view dia- 
gram of a device link page in accordance with the 
present invention; 

FIG. 8 graphically depicts a preliminary view of a 
session page in accordance with the present inven- 
tion; 

FIG. 9 is a block diagram illustrating a session man- 
ager causing two home devices to communicate 
over a home network according to certain embodi- 
ments of the invention; 

FIG. 1 0 graphically depicts a secondary view of the 
session page in accordance with the present inven- 
tion; 

FIG. 11 graphically depicts a third view of the ses- 
sion page in accordance with the present invention; 

FIG. 12A is a block diagram of a session page in 
accordance with the present invention; 

FIG. 12B is another block diagram of the session 
page in accordance with the present invention; 

FIG. 13 is another block diagram of the session 
page in accordance with the present invention; 

FIG. 14 is a block diagram of a home network that 
is connected to the Internet in accordance with the 
present inventions; 

FIG. 15 is a diagram illustrating the creation of a 
macro according to one embodiment of the inven- 
tion; and 

FIG. 16 is a diagram illustrating the creation of a 
macro according to another embodiment of the in- 
vention. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0049] The following description is provided to enable 
any person skilled in the art to make and use the inven- 



tion and sets forth the best modes presently contemplat- 
ed by the inventors of carrying out their invention of a 
method and apparatus for controlling home devices 
over a home network. In the following description, for 
purposes of explanation, numerous specific details are 
set forth in order to provide a thorough understanding 
of the present invention. It will be apparent, however, to 
one skilled in the art that the present invention may be 
practiced without these specific details. In other instanc- 
es, well-known structures and devices are shown in 
block diagram form in order to avoid unnecessarily ob- 
scuring the present inventions. 

[0050] In an exemplary embodiment of the present in- 
vention, a browser based home network uses Internet 
technology to control and command home devices that 
are connected to a home network. Each home device 
contains interface data (e.g. HTML, XML, JAVA, JAVA- 
SCRIPT GIF, JPEG, graphics files, or any other format 
useful for the intended purpose) that provides an inter- 
face for the commanding and controlling of the home 
device over the home network. In certain embodiments, 
each home device contains one or more Hypertext 
Markup Language (HTML) pages that provide for the 
commanding and controlling of the home device. Using 
the browser technology, the home network employs in- 
ternet standards to render the HTML pages in order to 
provide users with a plurality of graphical user interfaces 
("GU Is") for commanding and controlling each home de- 
vices. In one embodiment, the home network is config- 
ured as an intranet. 

[0051] FIG. 1 is a block diagram of a home network 
1 00 constructed in accordance with one embodiment of 
the present invention. As depicted in FIG. 1 , a 1394 se- 
rial bus 114 electronically connects multiple home de- 
vices on the home network 100. In this example, the 
1394 serial bus 114 provides the physical layer (medi- 
um) for sending and receiving data between the various 
connected home devices. The 1 394 serial bus 1 1 4 sup- 
ports both time-multiplexed audio/video (A/V) streams 
and standard IP (Internet Protocol) communications. In 
certain embodiments, the home network uses an IP net- 
work layer as the communication layer for the home net- 
work 100. However, other communication protocols 
could be used to provide communication for the home 
network. For example, the invention may be implement- 
ed using FCP (Function Control Protocol) as defined by 
IEC 61883, or any other appropriate protocol. Thus, a 
network may generally include two or more devices in- 
terconnected by a physical layer for exchange or trans- 
fer of data in accordance with a predefined communica- 
tion protocol. 

[0052] FIG. 2 illustrates an example of a layered in- 
terface model that can be used for communicating be- 
tween home devices in accordance with the present in- 
vention. In this example, a home device (server) 150 
communicates with a home device client 1 66 using net- 
work communication layers 152-164. By employing the 
Internet Protocol standard for the network layer 1 60, the 
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home devices can communicate with each other without 
having to know specific details about the other commu- 
nication layers (i.e. application 152, presentation 154, 
session 156, transport 158, data link 162 and physical 
1 64). Thus, by employing the Internet Protocol standard 5 
for the network layer 160, the home network may use a 
combination of different communication layers in com- 
municating between different home devices. It should 
be recognized that a single physical package may in- 
clude several devices which are logically networked via 
a network layer for example as shown in FIG. 2, not nec- 
essarily via a physical network. Such devices may in- 
clude a VCR and a TV in a single housing, for example. 
Thus, for such an embodiment, where a logical device 
accesses a GUI to enable a user to control a home de- 
vice, the home device and the logical device may be in- 
cluded in the same physical package. In such an em- 
bodiment, it could be considered that the physical de- 
vice fetches a GUI from itself. However, in other embod- 
iments the home network interconnects separate phys- 
ical devices, wherein for example, a first device fetches 
a GUI from a second device, to permit user interaction 
with the GUI to control the second device. 

[0053] By way of definition, it is contemplated that a 
"client" is a device providing control interface service to 
a human operator, including a graphical display hard- 
ware for down communication and a mouse or other 
point-and-click device for up (or return) communication. 

A "server" is contemplated as a module supplying a 
service, which may be any service other than a control 
interface provided by a client. Stated differently, the 
server/client relationship is a control relationship, 
wherein the server provides a service but a client may 
use the data, as a DTV displays video data, but does 
not manipulate or alterthe data. It is thus consistent with 
this definition to observe that, frequently, a server may 
be a source of information and a client (a browser, for 
example) may be a consumer of information. 

[0054] Some specific functions which may be imple- 
mented by servers include: return of information (data); 
performance of a function (e.g., mechanical function) 
and return of status; return of a data stream and status; 
reception of a data stream and return of status; or saving 
of a state for subsequent action. Examples of servers 
include MPEG source, sink and display servers. 

[0055] While a server typically includes a custom, 
built-in, control program to implement control of its own 
hardware, a client functions to interface with the server. 

It should be noted, however, that a "server" as used 
herein does not imply that a web server and a protocol 
stack must be used. 

[0056] In a presently preferred embodiment, a 1394 
serial bus is used as the physical layer 164 for the data 
communications on the home network 100. Because of 
its enhanced bandwidth capabilities, the 1 394 serial bus 
can provide a single medium for all data communica- 
tions on the home network 1 00 (i.e. audio/video streams 
and command/control). However, the home network 



100 is not restricted to using a 1394 serial bus, and, in 
alternative embodiments of the present invention, other 
bus types, such as Ethernet, ATM, wireless, etc., may 
be used as the physical layer if they meet the particular 
throughput requirements of an individual home network. 
[0057] As depicted in FIG. 1, the home network 100 
has several home devices connected to the 1394 serial 
bus 114. In this example, the home devices include a 
DBSS 1 04 which receives transmission signals from a 
satellite 1 22 for subsequent display. Associated with the 
DBSS is a network interface unit ("NIU") which, among 
other things, provides an interface between the DBSS 
satellite transmissions and the 1394 serial bus 114. 
[0058] A digital video device (“DVD") 1 08 is also con- 
nected to the exemplary home network 100. The DVD 
108 can be used to display digitally encoded videos on 
a home television. 

[0059] Also connected to the exemplary home net- 
work 100 is a digital video cassette recorder ("DVCR") 
110, i.e., a digital VCR, and a digital TV 102. 

[0060] In this example, the DTV 1 02 provides the hu- 
man interface for the home network 100 by employing 
browser technology to allow users to control and com- 
mand the home devices over the home network 100. 
Unlike most other home devices that are typically con- 
nected to a home network, the DTV 1 02 can provide the 
human interface for the home network 1 00 as it com- 
prises a screen for displaying HTML pages. However 
other home devices having a display capability may be 
used to provide the human interface. Thus, in certain 
embodiments of the inventions, a device such as a per- 
sonal computer (“PC") is used to provide the human in- 
terface for a respective home network, as a PC typically 
embodies a screen display unit. 

[0061] Although the 1394 serial bus 114 is depicted 
as using the HTTP/IP interface protocol, certain home 
devices may require other protocols interface types (e. 
g. TCP/IP, U DP/IP, FTP/IP, TELNET/IP, SNMP/IP, DNS/ 
IP, SMTP/IP). Therefore the HTTP/IP protocol may not 
be able to satisfy all home device connection require- 
ments. Thus, in certain embodiments of the invention, 
a bridge proxy 1 1 6 is used to interface two networks us- 
ing dissimilar interface protocols on their respective me- 
diums which, when connected, comprise the home net- 
work 100. In certain embodiments, the two network me- 
diums are of the same type. For example, as depicted 
in FIG. 1, the 1394 serial bus 114 using the HTTP/IP 
interface protocol is connected by a bridge proxy 116 to 
the 1394 serial bus 118, which uses the IEC61B83 in- 
terface protocol. By using bridge proxy 11 6 to interface 
between the HTTP/IP and IEC61 883 protocols, security 
system 120, which uses the IEC 61883 interface proto- 
col is also accessible on the home network 100. 

[0062] In certain other embodiments, a home network 
may be comprised of two network mediums of dissimilar 
types, e.g., a 1394 Serial bus and Ethernet. Therefore, 
in certain embodiments of the invention, a bridge proxy 
is used to interface two dissimilar medium types to form 
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a single home network. within the home device 204. The one or more HTML files 

[0063] The Dynamic Host Configuration Protocol are ASCII text files containing specific information per- 

(DHCP) server 1 06 is used for the discovery of home taining to the particular home device 204, along with da- 

devices that are powered on and connected to the home ta that enables a browser to present the information 



network 1 00. The home device discovery process is de- 
scribed in greater detail below. 

HOME NETWORK OVERVIEW 

[0064] As depicted in FIG. 1, DTV 102, DVCR 110, 
DVD 108, DSS-NIU 104 and security system 120 rep- 
resent home devices that are currently connected to the 
home network 100. A client-server relationship exists 
among the attached devices, with the DTV 1 02 typically 
behaving as the client and home devices DVCR 110, 
DVD 108, DSS-NIU 104 and security system 120 be- 
having as servers. 

[0065] As previously mentioned, each home device is 
associated with one or more Hypertext Markup Lan- 
guage (HTML) files. The HTML files define the control 
and command functions associated with a particular 
home device. Each HTML file may also contain embed- 
ded references to other HTML files. The browser based 
DTV 102 (acting as a client), receives and interprets the 
HTML files associated with the home devices (acting as 
servers) and graphically displays the respective control 
and command information on its viewable display. 
[0066] By conforming to the Hypertext Markup Lan- 
guage (HTML) and Hypertext Transfer Protocol (HTTP) 
Internet standards, each home device sends its custom 
GUI to the browser based DTV 1 02. The browser based 
DTV 1 02 receives the HTML files from the home devices 
over the home network 1 00 using the HTTP protocol. 
Each HTML file contains specific control and command 
information for a respective home device. The HTML 
files enable the browser based DTV 1 02 to graphically 
display control and command information to a user for 
a particular home device. Therefore, because each 
home device supplies its own GUI through its own HTML 
files to the browser based DTV 102, the browser based 
DTV 1 02 can provide a command and control interface 
for a home device without having to know any specific 
details about the particular device. This feature allows 
the home network 100 to contain home devices from a 
multitude of different manufacturers. 

[0067] In addition, home devices can be transparently 
added or removed from the home network 1 00 without 
affecting the overall system as, in accordance with the 
invention, each home device defines its own command 
and control interface through its respective HTML files. 

HTML TWO WAY MECHANISM 

[0068] FIG. 3A depicts an exemplary embodiment in 
which a browser based DTV 202 (client) renders the 
characteristics of a home device 204 (server) over a 
home network. The home device 204 is represented by 
one or more HTML files stored in an accessible area 



5 graphically. In addition to rendering the HTML file on the 
browser based DTV 202, by employing forms technolo- 
gy, the browser based DTV 202 can return information 
back to the home device 204, thus providing a two-way 
communication. Other common techniques for provid- 
io ing the two-way communication may include the use of 
Java or Control Gate Interfaces (CGIs). Once the infor- 
mation contained in a device's HTML file is graphically 
displayed on the DTV 202, the user can control the 
home device 204 from the DTV 202 by selecting icons 
is that have associated hyperlinks to start the control pro- 
grams displayed on the DTV's screen and/or entering 
data to the DTV 202. 

HOME DEVICE HTML FILES 

20 

[0069] As previously stated, each home device con- 
nected to the home network has one or more associated 
HTML files. The HTML files for a respective home de- 
vice define the control and command functions for that 
25 particular home device. Each HTML file may also con- 
tain embedded references to other related HTML files. 
A device connected to the home network that has a 
viewable display (e.g., screen) and employs the browser 
technology may receive and interpret the HTML files as- 
30 sociated with the home devices connected to the home 
network, and graphically display the information con- 
tained therein using a GUI on its screen. 

[0070] This is illustrated by FIG. 3A wherein is shown 
an interaction between a client and a server's executa- 
35 bles. However, it is a feature of the invention to provide 
control by interaction between executables of two serv- 
ers or of a client and plural servers. Thus, in accordance 
with the invention control is typically implemented by 
service control programs (executables which are trying 
40 to be operated remotely), communications, commands 
and (if necessary), human interface with a server control 
program via a GUI. 

[0071] As one example, FIG. 3B shows location of file 
and program components locally, permitting control ac- 
45 tions to be implemented by running programs and 
scripts on the device itself. This aspect of the invention 
thus permits implementation to be carried out in a local 
manner which may be proprietary to the device rather 
than being performed remotely, and which thus does not 
50 require a standardized 1394 command set. 

[0072] For example, the user may wish to change dis- 
play brightness. To implement such a change, the user 
may click on a "Brightness 0 button on the User HTML 
GUI page. In response, another GUI may be brought up, 
55 with "Bright" and "Dim" buttons. In response to the user 
clicking one of these two buttons, the http server will 
cause a brightness control program for the display to 
run, in order to control the desired hardware action. For 
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action local to the DTV, the DTV thus may include a serv- 
er capability, to interpret the post actions from the brows- 
er. 

[0073] In that regard, in order to be able to post ac- 
tions to control their local hardware, all home network 
DTV devices preferably have a server capability. For 
such operation, a browser may pick up local html files 
and render the files to a GUI, without invoking the http 
server. In order to invoke the local http server to re- 
spond, clicking on a button preferably involves an http 
access to the local machine name or IP address. In turn, 
the http server invokes the local device control program, 
such as "Brightness 11 in the above example. 

[0074] Generally, control may be implemented by 
transfer of a graphical control object (GCO), which pref- 
erably resides in the server, from the server for render- 
ing on the client, to make the GUI. As an advantageous 
result of this approach, detailed controls back to the 
server originating the GCO may be proprietary, as the 
server device "understands" and is aware of its own GUI 
controls. Additionally, the look and feel of the GUI orig- 
inates with the attached server (e.g., the program serv- 
er, server device or media) and not with the client. Inde- 
pendence of the command language makes the ar- 
rangement operable independently of any new features 
added to devices, which may be included in the GCO 
sent from the server, as well as any other future modifi- 
cations, i.e. , the home network configuration is made in- 
herently "new-feature proof" and "future proof'. 

[0075] Moreover, because a specific device may be 
selected forcontrol by selecting an icon, there is no need 
for hardware reconfiguration to implement control of dif- 
ferent (or updated) devices. Accordingly, a single com- 
mand set may be used in a remote control for controlling 
plural (different) devices, by communicating with the cli- 
ent device rendering of the GUI. 

[0076] For server to server control without a GUI and 
user involvement, automatic operation may be initiated 
or set-up by user control via a client, but later action is 
implemented by control language interaction between 
servers without involving a client. 

[0077] In order to implement the foregoing, a server 
operating in accordance with the invention preferably 
has one or more control programs for executing a re- 
quired service. The server, which stores its GCO, pro- 
vides the GCO to a client and a GUI rendered on the 
client interfaces with the server control program(s) exe- 
cutable^). Moreover, the server control program is able 
to save the state which has been controlled by the GUI, 
such as setting up a timer record action for example. 
The server also may include a clock for implementing 
various timer operations. The client is thus not required 
to have any knowledge of the server device being con- 
trolled, and It is not necessary to provide the client with 
the ability to save a previously controlled state. Indeed, 
as elsewhere described herein, the client may not be 
running for part of the time in which the server is running. 
Thus, preferably the server does not rely on another de- 



vice, such as the client, for its operation and may serve 
multiple clients simultaneously. 

[0078] A client, which receives GCO transfers from 
one or more servers, includes a GUI renderer to form 
5 the GUI from a received GCO. It is within the scope of 
the invention for a limited number of GCO's, for a limited 
number of servers, to reside in the client. However, for 
the inventive configuration of a home network, the large 
number of different server types presently in existence 
10 and contemplated for the future demonstrates the ad- 
vantage arising from the GCO's residing on the servers, 
thus freeing the client from a requirement for any built- 
in knowledge of the server(s) being controlled. 

[0079] In operation, during initial selection of the de- 
15 vice, the GCO is fetched and rendered by the client, to 
form the GUI and enable actions and responses to be 
communicated between the GUI and the control pro- 
gram^) of the client(s). 

[0080] For server-server control, a command lan- 
guage interface and library of commands may be pro- 
vided in a server. For any individual server, it is not nec- 
essary to provide the entire command language. In- 
stead, a server should only be able to support those 
commands which it needs to send and receive to per- 
form its functions. It is a simpler task to provide such a 
configuration than to build in the command language in- 
terface and library to a client for controlling all present 
and future servers. 

[0081] In addition to the one or more HTML files 
stored therein, each home device connected to a home 
network contains a Properties file. In one embodiment, 
the Properties file for a respective home device com- 
prises the device manufacturer's name, the device 
name, the device type, the device model, and the Uni- 
form Resource Locator ("URL") of the device manufac- 
turer's HTML home page. The top-level page associated 
with each home device may be called the device/default. 
HTML file. 

[0082] Each home device connected to the home net- 
work also contains a LOGO image file. A LOGO image 
file for a respective home device is a file containing an 
image that represents the manufacturer of the device. 
In one embodiment, the LOGO image file for a particular 
home device contains an image with the name and logo 
of the manufacturer of the home device. 

[0083] In the following description, a software agent 
which assists the user in interacting with the network 
and controlling the various home devices connected to 
the network, and thus acts as the primary interface be- 
tween the user and the home network, is called a ses- 
sion manager. For example, the software agent for the 
user (i.e. , the session manager) may access the devices 
to get more information for the user, in order to assist 
the user with making selections associated with the de- 
vices, or with managing the devices. Such assistance 
with control of a device may include modifying the GUI 
display for that device, as by graying out some buttons, 
thus inhibiting selection of various options (or devices) 



20 



25 



30 



35 



40 



45 



50 



55 



8 




15 



EP1 257 094 A2 



16 



based on prior selections and capabilities of devices. 
Still further, the session manager, acting as the user's 
agent, may link two or more devices selected by the user 
and may set up a communication path therebetween, 
freeing the user from the tedium and detail of implement- 
ing such control functions. 

[0084] In certain embodiments, in order for a session 
manager to properly locate the LOGO Image file of a 
respective home device, all home devices connected to 
the home network use a standard filename for the par- 
ticular LOGO image file to be displayed. In one embod- 
iment, each home device names its respective LOGO 
image file that is to be displayed LOGO.GIF. 

[0085] In certain embodiments, a LOGO image file for 
a respective home device is of a standard size, e.g. 1 20 
x 40 pixels. A standard size ensures that the device log- 
os have a neat, uniform look when depicted in the GUI 
displayed to the user. In certain embodiments, the im- 
age of the LOGO image file may also be animated. 
[0086] In certain embodiments, multiple versions of 
the LOGO image file may reside on a respective home 
device, with the home device responsible for determin- 
ing which version is ultimately displayed to the user. The 
home device may update the version to be displayed to 
the user over time, based on criteria of the device man- 
ufacturer's choosing. 

[0087] Each home device connected to a home net- 
work also contains an ICON image file. An ICON image 
file for a respective home device is a file containing an 
image that represents the particular type of home de- 
vice; e.g., a DTV or a DVCR. In certain embodiments, 
the ICON image file contains an image of the device or 
a symbol that represents the type of device. A manufac- 
turer model number may be included at the bottom of 
the image in the ICON image file, to assist in identifica- 
tion of the home device on the home network. 

[0088] In certain embodiments, several variations of 
the ICON image file reside on a respective home device, 
with each ICON variation representing a particular state 
of the home device. For example, fora DVCR, the ICON 
image files may contain images of a DVCR playing, re- 
winding, media inserted, media absent, etc. 

[0089] To represent the various device state images, 
the manufacturer may use a variety of symbols, colours 
and animation. The home device is responsible for de- 
termining which ICON image version is to be displayed 
to the user, based on the device's representative state 
at any particular time. This allows the ICON image file 
fora respective home device to provide feedback to the 
user as to the particular state of the home device. 
[0090] In certain embodiments, an ICON image file for 
a respective home device is of a standard size, e.g., 1 20 
x 90 pixels. A standard size ensures that the device im- 
ages will have a neat, uniform look when depicted in the 
GUI displayed to the user. In one embodiment, in order 
for a session manager to properly locate the ICON im- 
age file of a respective home device to be displayed, all 
home devices connected to the home network use a 



standard ICON image filename for the respective ICON 
image file to be displayed. Each home device may name 
its respective ICON image file to be displayed ICON. 
GIF. 

5 [0091] As previously stated, each home device con- 

nected to the home network has one or more HTML files 
associated with it. One of these HTML files is a home, 
or base page, file for the particular home device. To aid 
in the access of a particular home device's home page, 
io in certain embodiments, each home device uses a 
standard home page filename. In one embodiment, 
each home device names its respective home page file 
USER.HTML. 

HOME DEVICE DISCOVERY PROCESS 

[0092] Communication on the home network is pro- 
vided through the use of the Transmission Control Pro- 
tocol/Internet Protocol (TCP/IP) standard network pro- 
tocols. The TCP layer provides a reliable delivery mech- 
anism while the IP layer provides a routable addressing 
mechanism for packets of data on the home network 
1 00. In the home device discovery process, each home 
device is associated with a unique IP address and a log- 
ical name, which are used to identify a particular home 
device connected to the home network. To associate 
each home device with a unique IP address and logical 
name pair, a configuration manager is provided that dy- 
namically allocates a unique IP address and logical 
name for each home device that becomes available on 
the home network. An available home device is a home 
device that is both powered-on and connected to the 
home network. 

[0093] The IP address and logical name pairs of the 
available home devices are stored in a device list file 
within the configuration manager. The device list file is 
dynamically updated as home devices are added and 
removed from the home network 100 (i.e., become 
available and non-available on the home network 100). 
[0094] By using the configuration manager to allocate 
unique IP addresses for each home device, device man- 
ufacturers are relieved from having to associate a pre- 
defined IP address with each home device. However, in 
certain embodiments of the invention, when a particular 
home device is associated with a predefined IP address, 
the configuration manager uses the predefined IP ad- 
dress as the home device's unique IP address on the 
home network 100. 

[0095] In one embodiment of the invention , a dynamic 
host configuration protocol ("DHCP") server 1 06 of FIG. 
1 performs the functions of a configuration manager for 
a home network 100. The DHCP is a current industry 
standard and, for a particular home network, multiple 
home devices may be capable of performing the neces- 
sary DHCP server 106 functions. However, although 
multiple home devices may be capable of functioning as 
the DHCP server 106, in a presently preferred embodi- 
ment, the home device that is of the device type least 
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likely to be duplicated on the home network 100 (i.e., 
least likely to have more than one of its home device 
types resident on the home network 100) is nominated 
to function as the DHCP server 106. In the exemplary 
home network 1 00 of FIG. 1 , the DSS 1 04 is nominated 5 
to be the DHCP server 106 for the home network 100 
as it is least likely to be duplicated on the network 1 00. 
[0096] The DHCP server 106 on the home network 
100 generates a unique IP address and, for each home 
device that is available on the home network 100, re- 
trieves a logical name pair from the device. In certain 
embodiments, if an individual home device on the home 
network 100 has a predefined IP address already asso- 
ciated with it, the DHCP server 1 06 uses the predefined 
IP address as the unique IP address from that home de- 
vice. The DHCP server 106 causes the IP address and 
logical name pairs associated with the available home 
devices to be stored within a device list file. The device 
list file is dynamically updated as home devices are add- 
ed and removed from the home network 100. 

[0097] In certain configurations, a plurality of home 
devices with DHCP server capabilities may exist on a 
single home network. Therefore, in certain embodi- 
ments, an arbitration protocol is employed to select and 
designate a particular home device to function as the 
DHCP server for the home network. In another embod- 
iment, a communication protocol is employed between 
the various home devices with DHCP server capabilities 
that are present on a home network, resulting in a single 
designated DHCP server for the home network. 

[0098] FIG. 4A is a block diagram illustrating a home 
device discovery process according to an embodiment 
of the invention. When a home device 302 that is con- 
nected to the home network is powered on, the home 
device 302 broadcasts its presence over the home net- 
work in order to extract its configuration from the DHCP 
server 306. Upon receiving the broadcast, the DHCP 
server 306 generates a unique IP address and a logical 
name to be associated with the home device 302. After 
generating the unique IP address and looking up the log- 
ical name pair, the DHCP server 306 returns the IP ad- 
dress and logical name pair to the home device 302. 

The unique IP address is then used for communicating 
with the home device 302 over the home network. In 
addition to sending the IP address and logical name pair 
to the home device 302, the DHCP server 306 stores 
the generated IP address and logical name pair within 
the device list file. This discovery process is repeated 
for each home device that is powered on and connected 
to the home network. Thus, the DHCP server 306 pro- 
vides for the dynamic allocation of IP address and logi- 
cal name pairs for configuring newly attached and pow- 
ered on home devices. 

[0099] FIG. 3A depicts a flow diagram illustrating the 
generation of a device list file 318 according to certain 
embodiments of the invention. In this example, a DHCP 
Server 310 communicates with a home device 312 that 
is accessible on the home network in order to generate 



a unique IP address and logical name for the home de- 
vice 312. The DHCP Server 310 stores this information 
in the DHCP database 314. As home devices become 
available/non-availabie on the home network, the infor- 
mation in the DHCP database 314 is continually updat- 
ed in the manner described below. 

[0100] GENIP is a Win32 console-based application 
which interacts with external programs, databases (in- 
directly) and device/session managers. The core inter- 
action is an indirect contact with the standard DHCP 
Server product which is part of the standard Windows 
NT Server package, through a program known as DH- 
CPCMD.exe, which is part of the NT Server Resource 
kit found on MSDN developer DCROM sets. In opera- 
tion, DHCPCMD.exe interacts with the external pro- 
grams and databases via a command "enumclients", 
which creates a listing of all the current database of DH- 
CP clients. Thus, GENIP runs the DHCPCMD utility and 
generates an internal "current" database of IP leases 
active in the DHCP database from the output of the DH- 
CPCMD utility. 

[0101] The GENIP process 316 of FIG. 4B periodical- 
ly reads the device information contained in the DHCP 
database 314 and compares it with the device informa- 
tion currently contained in the device list file 318. By 
comparing the information the GENIP 316 can deter- 
mine if a home device has been added or removed from 
the home network. More specifically, the "current" data- 
base is compared item-for-item against the previously 
read database and, if any differences are found, a da- 
tabase update is performed thereby providing detection 
of any newly connected devices on the home network. 
[0102] In one embodiment, if the device information 
contained in the DHCP database 314 differs from the 
device information contained in the device list file 318, 
the GENIP process 316 signals a process to update a 
device link page and repaint a client display. The device 
link page is described in greater detail below. 

[0103] ReadDHCPDB() is the workhorse of GENIP, 
handling the setup and execution of DHCPCMD as well 
as reading the resultant output therefrom, reading the 
same into the "current" database, comparing with the 
"previous" database, and then writing a new "output" da- 
tabase for the clients. 

[0104] By default, GENIP operates on the DHCP da- 
tabase every 3 seconds, and it is thus advantageous to 
have GENIP running on the same physical machine as 
the DHCP server itself. Similarly, as the device and/or 
session managers will be accessing the output data- 
base frequently as well, the output file should be placed 
in a directory which is shared-out by the server and to 
which the clients have access. Although this requires 
agreement by the clients on where the output database 
is stored, this feature of the protocol may be improved 
upon by providing a protocol which both is non-polling 
for the events and also does not require manual config- 
uration. 

[0105] For example, instead of writing to a file, the Up- 
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dateDBO member of GENIP may prepare a network 
packet which could be broadcast into the subnet of in- 
terest, the packet containing instructions for the client 
on how and where to get the latest database informa- 
tion. This may be simply implemented by using the http 
protocol, placed on an unused port such as 8080 for ex- 
ample, so that the broadcast message would contain ht- 
tp://server_ip_address:8080/network_db.txt. The 
u network_db.txt" portion of the message would not be 
used if the only use for port 8080 is the network data- 
base. For improved future capability and expansion pur- 
poses, other information would be allowed to be trans- 
mitted via this same http port, and an actual full URL is 
provided. 

AUTO-TREE BUILDER 

[0106] In one embodiment of the invention, an auto- 
tree builder uses the contents of the device list file of a 
home network in order to generate a device link page. 
The device link page is displayed to the user on the 
screen of a browser based home device. The device link 
page contains a home device button for each home de- 
vice identified in the device list file. Each home device 
button in the device link page is associated with a hy- 
pertext link ( hyperlink ) to the top-level page of the re- 
spective home device. If a user selects a particular 
home device button contained in the device link page, 
the respective device's home page is subsequently dis- 
played to the user on the browser based home device's 
screen. 

[0107] FIG. 5B illustrates an example of a home de- 
vice tree structure 400 according to certain embodi- 
ments of the invention. In this example, the home device 
tree structure 400 contains a device list file 41 0, a device 
link page 412 and three top-level device pages (DSS 
414, DTV 41 6 and DVD 41 8). Using the device informa- 
tion contained in device list file 41 0, the auto-tree builder 
generates the device link page 41 2 and inserts links (e. 
g, hypertext links) to the top-level page of each device 
(DSS 414, DTV 416 and DVD 418). In this example, the 
device page DSS contains several data files 420 that 
can be accessed via the link between the device link 
page 412 and the DSS top-level device page 414. 
[0108] In certain embodiments, in generating the de- 
vice link page, the auto-tree builder uses the device list 
file to create a device HTML file that contains a home 
device button for each home device that is currently con- 
nected to the home network. Using the IP addresses 
contained in the device list file, the auto-tree builder ac- 
cesses each home device to obtain the Properties file 
information and the URL of the top-level page (i.e, US- 
ER. HTML file) associated with each home device. Using 
the respective URL information, the auto-tree builder 
converts each home device button in the device HTML 
file to a hyper-text link to the top-level page of the re- 
spective home device. This device HTML file is then 
used as the device link page. 



[01 09] For example, FIG. 5A is a device link page 402 
according to one embodiment of the invention. As de- 
picted, device link page 402 contains home device but- 
tons 406 for each home device connected to the home 
5 network 1 00. Each home device button 406 is associat- 
ed with a hypertext link to the top-level home page of 
the corresponding home device. If a user selects a par- 
ticular home device button 406 contained in the device 
link page 402, the respective device's home page is sub- 
sequently displayed to the user. 

[0110] In certain embodiments of the invention, the 
auto-tree builder also retrieves the ICON.GIF Image file 
that is stored in each home device. The auto-tree builder 
then uses the ICON.GIF images for displaying each of 
the corresponding home device buttons. 

[0111] In addition to the ICON images, in certain em- 
bodiments, the auto-tree builder also obtains the LOGO. 
GIF image file for each home device. The auto-tree 
builder associates each LOGO.GIF image with a hyper- 
text link to the home page of the device's manufacturer. 
The LOGO image is then included in the device HTML 
file. For example, FIG. 6 is a device link page 502 ac- 
cording to one embodiment of the invention. As depict- 
ed, the device link page 502 contains home device but- 
tons 504 and manufacturer device buttons 506. The 
home device buttons 504 are represented by the ICON. 
GIF images of each corresponding device. The manu- 
facturer device buttons 506 are represented by the LO- 
GO.GIF images of the respective manufacturer of the 
corresponding home device. 

[0112] In certain embodiments, as depicted in FIG. 7, 
the user may define the arrangement of device images 
602 and logos 604 on the device link page 606, accord- 
ing to his or her own criteria. For example, a user may 
arrange the device images 602 and associated logos 
604 in groups according to the respective home device's 
placement in the home, e.g., on a room by room basis. 
In such an example, a camcorder manufactured by 
SONY, a DTV manufactured by Samsung and a DBSS 
manufactured by Zenith may all be grouped in a living 
room group 608. In this embodiment, the user may also 
include additional text lines 610 to describe the group- 
ings and/or the devices depicted by the device images 
602 and associated logos 604. 

SESSION MANAGER 

[0113] As previously noted, a session manager pro- 
vides the primary interface between a user and a home 
network. The session manager, when properly activat- 
ed, generates a session page that provides an interface 
which allows users to command and control the home 
devices that are connected to the home network in order 
to perform various functions and/or services. Some typ- 
ical services that are available on a home network in- 
clude, but are not limited to, starting a movie playing, 
programming a DBSS, and recording a television pro- 
gram. 
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[01 1 4] The session manager displays available home 
network services (servers) and matches capabilities 
and selections made in one graphic user interface (GUI) 
with another GUI to facilitate sensible and easy selec- 
tion, thus simplifying use of the home network. 

[01 1 5] FIG. 9 is a block diagram illustrating a session 
manager 750 causing two home devices (DTV 752, 
DVCR 754) to communicate over a home network ac- 
cording to certain embodiments of the invention. As de- 
picted in this example, by sending command and control 
information to the home devices (DTV 752, DVCR 754), 
the session manager 750 causes the home devices 
(DTV 752, DVCR 754) to communicate with each other 
(i.e. audio/video stream). For example, to display a re- 
corded TV show, the session manager 750 sends com- 
mand/control information to cause the DVCR 754 to 
broadcast information (e g. the TV show) on a particular 
stream over the home network. In addition, the session 
manager 750 sends command/control information to 
cause the DTV 752 to display the information that is be- 
ing broadcast on the particular stream over the home 
network. 

[0116] Similarly, though not shown in the drawing Fig- 
ure, the session manager may send command/control 
information to cause a tuner (for example the DBSS) to 
broadcast a TV show on a stream over the network and 
may send further command/control information to either 
or both the DTV and DVCR to display and/or record the 
TV show. 

[0117] In still another alternate embodiment, if a sin- 
gle physical housing, or package, were to include both 
a DTV and a tuner (i.e., two separate logical devices), 
the command/control information sent to the housing 
would cause the tuner therein to broadcast a TV pro- 
gram on a stream over the home network to either (or 
both) the DTV in the same housing and/or to the sepa- 
rately housed DVCR. 

[0118] More specifically, client/server control actions 
may be implemented to initiate an A/V program source 
stream and a sink server stream. Once data is flowing, 
the session manager client may disengage from this ac- 
tivity and perform other functions. In controlling the illus- 
trative configuration, the session manager may cause 
the DVCR 754 to save a first state, e.g., "timer record", 
and the DTV to save a second state, e.g., "timer select 
a program". A clock later triggers the saved states into 
action. In this example, no further control actions are 
required of the session manager. However, for more 
complex examples, the session manager may remain 
in, or regain, control, or may initiate further control of 
other devices. 

[0119] Although the basic model illustrated in FIG. 9 
shows one client and two servers, one server represent- 
ing the control program controlling the DTV as providing 
a display service and the other representing the control 
program controlling the DVCR to provide a recording 
service, the model can be extended to a plurality of N 
servers where N> 2. 



[0120] FIG. 8 illustrates a session page 702 according 
to one embodiment of the invention. In this example, the 
session page 702 contains frames 704, 706 and 708. 
As depicted, frame 704 contains a device link page 71 0 
5 that contains device buttons 712 for each home device 
currently connected to the home network. 

[0121] When the session manager is activated, it 
causes the auto-tree builder process to generate a new 
device link page. In certain embodiments, the session 
manager is notified as home devices are dynamically 
added and removed from the home network. For exam- 
ple, referring back to FIG. 4B, when the GENIP process 
31 6 determines that a home device has been either add- 
ed to or removed from the home network, the GENIP 
process 31 6 notifies the session manager. The session 
manger then causes the auto-tree builder process to 
generate a new device link page. 

[0122] In an alternative embodiment, the session 
manager periodically polls the device list file 318 to de- 
termine if it has been updated with new home device 
information. If the session manger determines that de- 
vice list file 31 8 has been updated, the session manager 
causes the auto-tree builder process to generate a new 
device link page. 

[0123] In certain embodiments of the invention, the 
auto-tree builder process functions are contained within 
the session manager. Thus, in one embodiment of the 
invention, the session manager generates the device 
link page by performing the previously described auto- 
tree builder functions. 

[0124] A critical function of the session manager is to 
enable a user to initiate an available service on the home 
network. An available service is a particular function that 
can be performed by one or more home devices that are 
currently powered-on and connected to the home net- 
work. For example, a service may consist of selecting a 
DTV for viewing a particular TV show and tuning the DB- 
SS to a particular station that is carrying the respective 
TV show. 

[01 25] To enable a user to initiate an available service, 
when the user selects a particular home device button 
712 from the device link page 710, the session manger 
causes the top-level home page of the selected home 
device to be displayed within a frame contained in ses- 
sion page 702. For purposes of explanation, it shall be 
assumed that a user selects the device button 712 cor- 
responding to "Dad's TV". 

[0126] As shown in FIG. 10, when the user selects the 
device button 712 for Dad's TV, the session manager 
displays the top-level home page 804 for the respective 
home device in a frame 706 of the session page 802. 
FIG. 10 is similar to FIG. 8 and, therefore, like compo- 
nents have been numbered alike. As depicted in FIG. 
10, in certain embodiments of the invention, the LOGO 
image 806 that is associated with the selected home de- 
vice is displayed within the frame 706. 

[01 27] After a device image 71 2 is selected, the ses- 
sion manager continues to display the contents of the 
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device link page 71 0. However, in certain embodiments, 
the selected device button 712 is deactivated and is, 
therefore, non-responsive for further selection by the us- 
er. For example, when the device button 712 corre- 
sponding to Dad's TV is selected, it is deactivated and 
becomes non-responsive to further selection by the us- 
er. 

[01 28] When the user selects a home device button 
712, the session manager obtains the particular capa- 
bilities of the selected home device. The particular ca- 
pabilities of a home device includes a list of standard 
named functions that the respective home device is ca- 
pable of performing, e.g., the capabilities of a DVCR 
generally include "accepting video" and "displaying vid- 
eo". 

[01 29] In certain embodiments, the session manager 
obtains the particular capabilities of a selected home de- 
vice by accessing a standard named file on the respec- 
tive home device. 

[01 30] After obtaining the particular capabilities of the 
selected home device, the session manager searches 
the capabilities of the other home devices that are rep- 
resented in the device link page 710 (i.e., listed in the 
device list file), for matches to the particular capabilities 
of the selected home device. For each home device 
found to have a matching capability to the selected 
home device, the session manager continues to activate 
the respective device button 712 (i.e., maintains it re- 
sponsive to selection by the user). For each home de- 
vice that is found to have no matching capabilities to the 
selected home device, the session manager deacti- 
vates the respective device button 712 (i.e., sets it non- 
responsive to selection by the user) in order that the user 
may not further select the respective device for the cur- 
rent session. 

[0131] For example, where the user has selected a 
client device such as a TV display, the session manager 
may specifically search for matching devices which are 
capable of acting as video servers, or sources, rather 
than for other displays. Under such circumstances, the 
session manager may deactivate buttons for other dis- 
plays. Alternatively, in a "control only" mode of opera- 
tion, where a server-client relationship is not being es- 
tablished, the session manager does not seek a second 
device which may act as a source for the selected de- 
vice. 

[0132] More particularly, in accordance with the in- 
vention it is possible to operate with a number of soft- 
ware agents representing devices which are capable of 
controlling lights, for example. In such an environment, 
the user would select both a control device, which is not 
a source or server of information, and one or more light 
devices to be controlled thereby. When the user first se- 
lects the control device, the session manager may then 
identify various devices capable of being controlled by, 
or interacting with, the selected device and continue to 
activate the respective device buttons thereof, while de- 
activating the buttons for other devices. Indeed, it should 



be appreciated that the session manager may select 
any number of devices for presentation to the user as 
possible choices for operation, for which the selection 
buttons remain activated. The devices may or may not 
5 co-operate with each other. That is, the devices whose 
buttons remain activated may operate in cooperation 
with, or independently of, each other. 

[0133] Where an information presentation device is 
selected, it may be possible that a plurality of servers 
io may remain active for possible selection. For example, 
in accordance with some embodiments of the invention, 
when a device button for a DTV or DVCR is selected, 
the session manager may activate device buttons for 
several information sources, such as an audio server 
is and a video server. I ndeed, it Is also possible that device 
selection buttons may remain activated for selection of 
plural video servers, and that upon selection of one vid- 
eo server the buttons for selection of other servers will 
be maintained activated, to account for situations 
wherein it is desired to provide multiple images on a sin- 
gle display. For example, it may be desirable to display 
an entertainment video while simultaneously displaying, 
as a picture-in-a-picture, video from a security camera 
or from another server. Alternatively, video information 
from one or more sources may be communicated to a 
plurality of client displays. 

[0134] It should thus be appreciated that, as appropri- 
ate information on capabilities of device interaction is 
provided to the session manager, the session manager 
will indicate that various of the devices are, or are not, 
enabled for selection by the user based on the user's 
prior selections. By acting as an agent for the user, the 
session manager obtains information relating to device 
capability and, in response thereto, deactivates selec- 
tion buttons for particular devices while maintaining ac- 
tive the device selection buttons for other devices. By 
determining whether and which devices have matching 
capabilities, and by graying out (deactivating) buttons 
for non matching devices and activating buttons for 
matching devices, the session manager thus assists the 
user with making selections associated with the devic- 
es, or with managing the devices. 

[0135] With such assistance, the user may then select 
a second home device to interact with the previously se- 
lected home device in orderto perform the desired serv- 
ice. Where the session manager has inhibited some se- 
lection possibilities and enabled others, the user's se- 
lection is simplified. Where the matching, selection, in- 
hibiting or enabling has not been carried out by the ses- 
sion manager, the user performs the selection based on 
various criteria. For example, the user may simply wish 
to select or activate a specific device. Alternatively, the 
user may wish to select all devices capable of perform- 
ing a specific function. 

[0136] In that regard, the session manager may gen- 
erate a page which includes all contents of the network, 
and all functional capabilities, independent of specific 
device. Thus, the HTML page may identify services 
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available to the user by content, such as by providing a 
list of video or audio programs, etc., which are available 
on the home network regardless of the device on which 
such content is being provided. Such a display is user 
transparent in the sense that the user is permitted to 
select information sources based on content, rather 
than equipment, device or channel through which the 
information is made available. 

[01 37] On selecting the second home device, the ses- 
sion manager displays the home page for the second 
home device in frame 708. The order in which frames 
are chosen for displaying the home page of each select- 
ed device is not critical, and therefore, in certain embod- 
iments of the invention, the home page of the first se- 
lected device is displayed in frame 708 and the home 
page of the second selected device is displayed in frame 
706. 

[0138] FIG. 11 illustrates session page 902 after the 
selection of a second home device according to one em- 
bodiment of the invention. As shown in FIG. 11, when 
the user selects the device button 71 2 corresponding to 
Jim's DVD in this example, the session manager dis- 
plays the top-level home page 904 for the respective 
home device in a frame 708 of the session page 902. 
FIG. 11 is similar to FIG. 9 and FIG. 10 and, therefore, 
like components have been numbered alike. As depict- 
ed in FIG 11, in certain embodiments of the invention, 
the LOGO image 906 associated with the selected 
home device is displayed within the frame 708. 

[01 39] Once two home device images have been se- 
lected, the session manager allows the respective home 
devices to communicate with each other to set up and 
perform the desired service as selected by the user 
through the options displayed on the respective home 
pages 804 and 904 of each selected home device. 
[0140] An example of an embodiment of a session 
manager session 1002 is displayed in FIGS. 12A, 12B 
and 13. In this example, as depicted in FIG. 12A, the 
user may choose one of four device images displayed 
in a device link page 1 022 contained in frame 1 004 of a 
session page 1012. In this example, the user may select 
a DSS device button 1014, a CD device button 1016, a 
DTV device button 1018 ora D VCR device button 1020. 
For explanation purposes, it shall be assumed that the 
user selected the DVCR device button 1020. 

[0141] As depicted in FIG. 12B, when the DVCR de- 
vice button 1020 is selected, the session manager dis- 
plays the home page for the respective DVCR in frame 
1006 of the session page 1012. The session manager 
continues to display the four device images in the device 
link page 1 022 of the session page 1 01 2. After the user 
selects the DVCR device button 1 020, the session man- 
ager determines the particular capabilities of the select- 
ed DVCR device and compares them with the particular 
capabilities of the other accessible devices on the home 
network, i.e., the DBSS, the CD and the DTV. 

[0142] In this example, the session manager deter- 
mines that there is a match in capabilities between the 



selected DVCR and both the DTV and the DBSS. The 
session manager also determines that there is not a 
match between the capabilities of the selected DVCR 
and the capabilities of the CD. Thus, the session man- 
5 ager deactivates the device button 1016 for the CD in 
the device link page 1022. Additionally, because the 
DVCR device button 1 020 was selected by the user, the 
session manager now deactivates the DVCR device 
button 1020 on the device link page 1022. 

[0143] Because the session manager found matching 
capabilities between the selected DVCR and the DBSS 
and the DTV devices connected to the home network, 
the session manager continues to keep the device but- 
tons 1014 and 1018 active for these respective home 
devices in the device link page 1022. Therefore, in this 
particular example, the user may now additionally select 
either the DTV device button 1018 or the DSS device 
button 1 01 4 in order that the selected respective device 
may interact with the previously selected DVCR to per- 
form a particu lar service onthehome network. H owever, 
because the CD device button 1016 has been deacti- 
vated, as there are no shared capabilities between the 
CD and the previously selected DVCR, the user may not 
select the CD device button 1016 at this time. 

[0144] In this example, the user additionally selects 
the DTV button 1018 contained in the device link page 
1022 . 

[0145] As depicted in FIG. 13, the session manager 
then displays the home page for the respective DTV in 
frame 1 008 of the session page 1012. The session man- 
ager continues to display the DVCR device's home page 
in frame 1006 and the four device buttons 1014, 1016, 
1018 and 1020 in the device link page 1022 of the ses- 
sion page 1012. The user may now select control op- 
tions from the home pages of each selected device (e. 
g., play 1044 and volume 1042 respectively from the 
DVCR and the DTV home pages) in order to command 
and control the respective home devices to function in 
a particular manner. 

[0146] Any home device connected to a home net- 
work that can act as a client, i.e., which has the capability 
to display HTML files via is respective display unit (e.g., 
a DTV or a PC), may be designated a session server. A 
session server is a device that contains a session man- 
ager, a display unit (i.e., screen), its own HTML page 
files, including a top-level, home HTML page file, and a 
browser. 

[01 47] In certain embodiments, when a session serv- 
er (e.g., a DTV, general purpose computer) powers up, 
the associated session manage is executed and a ses- 
sion page, as discussed previously in FIG. 12A, is dis- 
played on the display unit of the particular session serv- 
er. The user may then select a home device to command 
in order to perform a desired function or service. 

[0148] In an alternative embodiment, when a session 
server powers up, its respective browser runs and dis- 
plays the top- level home page for the respective session 
server. In certain embodiments, the session server's 
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home page is associated with a standard filename, such 
as USER.HTML. Associated with the session server's 
home page is a device page button option which, when 
selected, causes the session manager executing on the 
session server to display a session page as discussed 5 
previously in FIG. 12A. 

EXECUTING A SERVICE 

[0149] As previously indicated, the session manager 
is the primary interface between the user and a home 
network. It is a tool capable of accessing and controlling 
every home device on the network, and, generally, 
should be available on every browser-based home, i.e., 
client, device. 

[01 50] The session manager enables a user to begin 
a service on the home network. As previously dis- 
cussed, in relation to FIGS. 1 2A, 1 2B and 1 3, a session 
manager allows an user to choose up to two home de- 
vices at one time, which he or she wishes to control to 
perform a specific service. 

[01 51 ] Each home device possesses one or more ca- 
pabilities. For example, a DVCR is capable of both ac- 
cepting and outputting a video signal, a CD player is ca- 
pable outputting an audio signal, and a DTV is capable 
accepting video signal. Capabilities are either source- 
like or sink-like. A CD player posses a source-like capa- 
bility as it is capable of outputting an audio signal. In 
contrast, a DVCR possess both source-like and sink- 
like capabilities as it can accept and output a video sig- 
nal. 

[01 52] Each source-like capability has a complement- 
ing sink-like capability that is compatible with it. For ex- 
ample, the outputting video capability of one home de- 
vice is complemented by the accepting video capability 
of a second home device. Each capability is associated 
with a certain set of data specifications. For example, 
when a DVCR outputs a video signal, the video signal 
is broadcast on a particular stream of the over the home 
network. The stream number and other information 
about the signal form part of the DVCR's (outputting 
home device) data specification message. Therefore, in 
one embodiment, to execute a session, a first home de- 
vice (outputting home device) communicates a data 
specification message to a second home device (ac- 
cepting home device) via the session manager. 

[0153] To provide for home device communication, 
each home device has a control application associated 
with it. The control application for a home device han- 
dles the communication between the session manager 
of the respective home network and the home device. 
Therefore, the control application for two respective 
home devices, provides a mechanism that allows two 
home devices to communicate with each other via the 
control manager. In certain embodiments, the control 
application is a device-specific packet of Java code that 
communicates with the hardware of the respective 
home device, thereby controlling that home device. 



[0154] By having a control application associated with 
each home device on the home network, the control im- 
plementation details of the respective home device are 
grouped and maintained within a vendor-supplied de- 
vice application. The control application of a home de- 
vice further enables the respective vendors to provide 
their own control scenarios for their devices. All of the 
control applications of the home devices on the home 
network, however, must comply with certain pre-defined 
specifications in order to enable a respective home de- 
vice to communicate with the session manager. 

[0155] In certain embodiments, each home device on 
the home network has a list of data specifications asso- 
ciated with it. For example, a DVCR that has been in- 
structed to "Output Video", i.e., transmit a video signal, 
broadcasts the video signal on a particular isochronous 
stream. The stream identification information and other 
details about the video signal form part of the data spec- 
ifications for the DVCR. The control application of a 
home device, e.g., a DVCR, is capable of storing and 
advertising the home device's data specifications when 
queried by the session manager. 

[0156] As previously discussed, the session manager 
can query various home devices for their particular ca- 
pabilities. The session manager is also responsible for 
querying various home devices for their data specifica- 
tions, in order to ensure the requested user service is 
properly established and performed. 

[01 57] Once a user selects two home devices to per- 
form a particular service, the user must choose certain 
device options for each of the selected home devices to 
perform that particular service. By choosing various de- 
vice options, the respective device's hardware is initial- 
ized to perform the service. The session manager coor- 
dinates the communication between the selected devic- 
es to establish their hardware configurations and to per- 
form the requested service. 

[0158] As an example, referring again to FIG. 13, if a 
user wishes to play a video on the DTV, the service will 
consist of the playing of a video in the DVCR and the 
displaying of the respective video on the DTV. After the 
user selects the PLAY command option on the DVCR, 
the DVCR, among othertasks, chooses the isochronous 
stream that the video signal will be broadcast on. This 
information, as well as other pertinent information re- 
garding the signal to be broadcast and the particular 
DVCR hardware setup for broadcasting, i.e., the data 
specifications of the DVCR for the PLAY service, are 
subsequently forwarded to the session manager. 

[01 59] The session manager, upon receiving the data 
specifications from the DVCR, f onwards the information 
to the DTV, in order that the DTV may properly initialize 
its hardware to display the video signal broadcast by the 
DVCR. Some time thereafter, the session manager de- 
letes the session page 1012 from the DTV display 
screen, allowing the DTV to display the video broadcast 
by the DVCR. 
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EXTERNAL CONNECTION 

[01 60] Because the home network is Internet protocol 
compatible, connecting the home network to the Internet 
can provide the advantage of being able to control home 5 
devices from outside the home. Therefore, in certain 
embodiments of the invention, a connection is provided 
which allows the home network to interface with the In- 
ternet. FIG. 14 depicts a home network 1100 connected 
to the Internet 1102 in accordance with the present in- 
vention. Because many of the components in FIG. 14 
are similar to FIG. 1, like components are numbered 
alike. 

[0161] As depicted in FIG. 14, in certain embodiments 
an Internet proxy 1104 is used to provide an interface 
between the home network 1100 and the Internet 1102. 

By providing an interface between the home network 
1 1 00 and the Internet 1 1 02 a user can remotely control 
home devices connected to the home network 1 1 00. For 
example, if a user is required to work late and is there- 
fore unable to watch the Monday night football game, 
the user can program a DVCR connected to their home 
network via the Internet, in order to record the particular 
event. 

[0162] Connecting the home network to the Internet 
can induce potential security access issues. Therefore, 
in certain embodiments, a security mechanism is asso- 
ciated with the home network that is used to restrict ac- 
cess to the home network to particular authorized users. 

MACROS 

[0163] As described above, a user must typically per- 
form a sequence of steps in order to cause a home de- 
vice to execute a particular service. In addition, because 
users of a home network typically have dissimilar pref- 
erences as to the particular settings of certain home de- 
vices, a sequence of steps may be repeatedly per- 
formed in order to adjust the settings of a respective 
home device. For example, a first user may have a par- 
ticular preference as to the brightness, tint and/or con- 
trast of a particular D7V, while a second user has differ- 
ent preferences. To reduce the number of repeated 
steps typically performed by a user to set the settings of 
a particular home device, in certain embodiments of the 
invention a sequence of steps can be saved as a macro. 
[0164] A macro is a sequence of commands that is 
saved in memory on a home device and which can be 
accessed and executed by a user. The macro executes 
as if the user actually selected a particular button or per- 
formed a particular action from within a HTML page con- 
tained on the respective home device. 

[0165] The use of macros can significantly reduce the 
amount of work that is required by a user to perform a 
particular function as a single macro can be used to fa- 
cilitate the convenient setup and control of several de- 
vices in tandem. For example, a user may want to record 
a particular TV program on channel 2 at 8:00 p.m. for 1 



hourevery Tuesday night. This normally requires the us- 
er to select a DBSS or DTV as the sou rce of the program 
and to enter a particular sequence of steps to program 
a DVCR to receive and record the program. However, 
using a macro, the user need only perform the step of 
executing the particular macro. The macro then exe- 
cutes the necessary steps of selecting and commanding 
the particular devices in order to record the program. 
[0166] There are multiple ways of generating macros 
depending on the particular respective home devices' 
software capabilities and the implementation of their 
HTML pages. In certain embodiments of the invention 
a preset type of macro Is used which saves the actual 
values of a device's parameters. The preset type of mac- 
ro can be used in a home network in which the param- 
eter values of a particular home device can be queried 
and set. The preset macro is created by saving the cur- 
rent value of a particular set of home device parameters. 
Each macro is associated with a name so that it can be 
easily retrieved and executed at a later time. When a 
macro is subsequently executed it issues the appropri- 
ate commands to set the chosen parameters of the re- 
spective home device to their assigned value. 

[0167] For example, FIG. 15 depicts the creation of a 
preset macro 1 200 according to one embodiment of the 
invention. As depicted in FIG. 1 5, when a create macro 
button 1202 on a respective HTML page of a home de- 
vice is selected, a macro generation process 1204 be- 
gins to execute. Execution of the macro generation 
process 1 204 causes a set of user selected device pa- 
rameter values 1208, selected from the home device’s 
parameter list 1206, to be saved to a macro file 121 0. 
The macro file 1210 is assigned a unique macro name 
1212 and saved on the home device. The macro name 
1212 is saved as a macro name button on the home 
device's macro list HTML page 1214. Thereafter, a user 
may select the macro name button, causing the respec- 
tive macro file 1 21 0 to be executed. 

[0168] In one embodiment of the invention, a macro 
button is included on a respective home devices HTML 
home page. Selecting the macro button causes the 
macro list HTML page 1 21 4 to be displayed to the user. 
In one embodiment, the create macro button 1202 is 
contained on the macro list HTML page 1214 for a re- 
spective home device. 

[0169] In an alternative embodiment, a player piano 
macro is created by a home device's software and/or 
hardware saving the particular steps taken by a user 
while interacting with the device's HTML pages (e.g. , the 
user's button selections, data entries and/or cursor 
movements are saved as they are executed by the us- 
er). Again, the created macros are associated with a 
particular name so that they may be easily retrieved and 
executed at a later time. When the player piano macro 
executes, it performs the particular sequence of instruc- 
tions as if the user was accessing the respective home 
device HTML page(s) and executing the sequence of 
steps directly. 
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[0170] For example, FIG. 1 6 depicts the creation of a 
player piano macro 1300 according to one embodiment 
of the invention. As depicted in FIG. 16, when a create 
macro button 1302 is selected a macro generation proc- 
ess 1304 begins to execute. Execution of the macro 5 
generation process 1 304 causes a user interaction 1 306 
to be interpreted as a particular action by a command 
interpreter 1308. The respective actions are copied into 
a macro file 1310, which is saved on the respective 
home device and assigned a unique macro name 1312. 

The macro name 1 31 2 is saved as a macro name button 
on the home device's macro list HTML page 1314. 
Thereafter, a user may select the macro name button, 
causing the respective macro file 1310 to be executed. 
[0171] In addition to the user created macros, in cer- 
tain embodiments of the invention, a predefined set of 
macros are stored in the respective home device's 
memory for access by a user. Because macros are typ- 
ically device dependent, in certain embodiments of the 
invention the manufacturer of a particular home device 
creates and defines a set of macros that can be execut- 
ed on the respective home device. 

HOME NETWORK PROGRAM GUIDE 

[01 72] To provide a user with a list of available multi- 
media material (e.g., audio and video programs, TV pro- 
grams, and CDs), one or more home network program 
guides are associated with a home network. The one or 
more home network programming guides may be cate- 
gorized as to the available multi-media material on a 
particular home device or may be combined in various 
ways to depict a particular group of accessible multi-me- 
dia material. 

[0173] A television programming guide typically pro- 
vides a list and schedule of programs that are available 
for viewing on a particular channel. Most digital satellite 
services provide programming information through an 
Electronic Programming Guide (EPG). The EPG dis- 
plays a list of available programs and the specific time 
in which the programs can be viewed through the serv- 
ice. The EPGs are continually updated to reflect a cur- 
rent window of available programs. The home network 
uses the EPG information to build a home network 
HTML program guide. The HTML program guide is de- 
veloped using the HTML standards and can be dis- 
played on a browser based home device. In addition, 
users can customize the particular programming infor- 
mation that is displayed. For example, if a user would 
prefer not to display the schedule for a particular chan- 
nel, e.g., because of its programming contents, the user 
may request that channel be removed from the HTML 
program guide. 

[0174] The information contained in an EPG is de- 
pendent on the particular DBSS that is used, and as 
such, there is currently no standard format for transmit- 
ting this information. Therefore, in one embodiment of 
the invention, a process extracts the information from a 



particular EPG and converts it into a standard program 
format. The standard program format is then used to 
build an HTML program guide. The HTML program 
guide can be displayed on any browser based home de- 
vice (e.g., a DTV or a PC), Like the EPGs, the HTML 
program guide is periodically updated to reflect the cur- 
rently available programs. As stated above, the user can 
customize the displayed HTML program guide to view 
only a particular set of the available information. 

[0175] If an EPG format standard is developed, the 
HTML program guide can be built without first convert- 
ing the EPG information into the standard program for- 
mat. Therefore, in certain embodiments of the invention, 
the HTML programming guide is built using a standard 
EPG format as transmitted by a particular DBSS. 
[0176] In addition to the EPG received on a DBSS, 
the home network can be associated with other home 
devices that contain multi-media material. For example, 
a DVD may contain certain movies, a PC may contain 
specific files (e.g., games, picture images), a DVCR may 
contain a particu lar movie, and a CD player may contain 
specific CDs. In certain embodiments, each home de- 
vice maintains an HTML program guide file that contains 
a list of the material currently available on the respective 
home device. Using a browser based home device, a 
user can display the available material on a particular 
home device by rendering the particular home device's 
HTML program guide file. 

[0177] In certain other embodiments of the invention, 
a multi-media identification process is tasked with 
searching the accessible home devices to determine 
what material is currently available on each of them. In 
one embodiment, the multi-media identification process 
accesses each home device to obtain a file or directory 
that contains a list of the available material on the par- 
ticular home device. A home device contents process 
then creates one or more HTM L program guide files that 
depict the material currently available to the user. A user 
can display the available material by rendering a partic- 
ular HTML program guide file. 

[0178] In an alternative embodiment, the multi-media 
identification process obtains the HTML program guide 
file that is maintained on a respective home device. Us- 
ing the HTML program guide files obtained from the par- 
ticular home devices of the home network, the multi-me- 
dia identification process creates one or more HTML 
program guide files that depict the material currently 
available to the user. A user can display the available 
material by rendering a particular HTML program guide 
file. 

CONCLUSION 

[0179] In accordance with the described invention, 
control of a plurality of devices (for example, a VCR, a 
CD player, a DVD player or any other device) is imple- 
mented with the aid of a single control loop, established 
from a video display of a client device (such as a TV or 
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a PC) to a user, to a remote control device, to a detector 
(such as an IR detector) on the client device. Such a 
control loop is usable for controlling the plurality of de- 
vices, thereby eliminating a requirement for front panel 
controls on such devices. In one form of the invention, 
the control loop may be implemented by connecting the 
devices to a home network. Instead of using traditional 
front panel controls, the invention thus provides for con- 
trol of such devices through the home network by inter- 
action with the respective GUI thereof as rendered on 
the client device. The invention also eliminates a re- 
quirement for a remote control device to include therein, 
or to have access to, control codes specific to each of 
the devices on the network. In the illustrative embodi- 
ment described herein, the remote control device may 
fetch a GUI to provide the appropriate control function. 
In a modification, the remote control may include a dis- 
play thereon for displaying the fetched GUI, thus elimi- 
nating a need for a separate display on a client device. 
The invention thus permits the remote control to access 
and control a plurality of devices using a single remote 
control and a single display, with a single method of dis- 
play and operation, without requiring any change in the 
mode of operation thereof to change the device control- 
led thereby. 

[01 80] The foregoing description of the preferred em- 
bodiment of the invention has been presented for pur- 
poses of illustration and description. It is not intended to 
be exhaustive or to limit the invention to the precise 
forms disclosed, since many modifications or variations 
thereof are possible in light of the above teaching. All 
such modifications and variations are within the scope 
of the invention without departing from the broader spirit 
and scope of the invention. The embodiments described 
herein were chosen and described in order best to ex- 
plain the principles of the invention and its practical ap- 
plication, thereby to enable others skilled in the art to 
utilize the invention in various embodiments and with 
various modifications as are suited to the particular use 
contemplated therefor. It is intended that the scope of 
the invention be defined by the claims appended hereto, 
when interpreted in accordance with the full breadth to 
which they are legally and equitably entitled. The spec- 
ification and drawings are, accordingly, to be regarded 
in an illustrative rather than a restrictive sense. 

[01 81 ] Those skilled in the art will appreciate that var- 
ious adaptations and modifications of the just-described 
preferred embodiments can be configured without de- 
parting from the scope and spirit of the invention. There- 
fore, it is to be understood that, within the scope of the 
appended claims, the invention may be practiced other 
than as specifically described herein. 



Claims 

1. A method of interfacing between devices compris- 
ing the step of: 



(a) embedding self-describing information with- 
in a first device; and 

(b) configuring the first device to allow a second 

5 device to access the self-describing informa- 

tion for interfacing with the first device. 

2. The method as claimed in claim 1 wherein the self- 
describing information includes a graphical repre- 
sentation of the first device. 

The method as claimed in claim 1 2 when dependent 
upon claim 2, wherein the self-describing informa- 
tion includes an address from where additional in- 
formation about the first device is obtained. 

The method as claimed in claim 3 further compris- 
ing the step of providing an interface on the second 
device using the self-describing information, where- 
in a user has the ability to control operation of the 
first device through the interface. 

The method as claimed in claim 4 wherein the in- 
terface includes the graphical representation of the 
device and available controls. 

The method as claimed in claim 5 wherein the self- 
describing information includes a Java applet. 

The method as claimed in claim 6 wherein the Java 
applet provides a graphical user interface through 
which a user is provided access to a user applica- 
tion. 

The method as claimed in claim 5 wherein the ad- 
dress points to a location within a network of devic- 
es which includes the first device and the second 
device. 

The method as claimed in claim 5 wherein the ad- 
dress is modifiable. 

A device including self-describing information com- 
prising: 

(a) means for storing self-describing informa- 
tion; 

(b) a physical interface for allowing the device 
to communicate with other devices including 
transmitting the self -describing information; 
and 

(c) a controller coupled to the means for storing 
and to the physical interface for controlling 
communication through the interface with other 
devices. 
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11. The device as claimed in claim 10 wherein the self- 
describing information includes an address from 
where additional information about the device is ob- 
tained. 

12. The device as claimed in claim 10, or the method 
as claimed in claim 2, wherein the self-describing 
information includes information regarding controls 
and functionality of the device. 

13. The device as claimed in claim 12 wherein the self- 
describing information is used to provide a graphi- 
cal interface on a controller device for controlling 
operation of the device through the controlling de- 
vice. 

14. The device as claimed in claim 10 wherein the 
means for storing self-describing information in- 
cludes a media device. 

15. The device as claimed in claim 10 wherein the 
means for storing self-describing information in- 
cludes a broadcast receiving device. 

16. The device as claimed in claim 10 wherein the phys- 
ical interface is an IEEE 1394 interface for interfac- 
ing the device to an IEEE 1 394 serial bus structure. 

17. A system configuration comprising: 

(a) a plurality of devices coupled together, each 
of the plurality including: 

I. means for storing self-describing infor- 
mation; and 

II. a physical interface for allowing the de- 
vices to communication with other devices 
including transmitting the self-describing 
information; and 

(b) a system coupled to the plurality of devices 
for presenting a graphical interface, utilising the 
self-describing information from each of the 
plurality of devices, through which operation of 
the plurality of devices is controlled, the system 
including a microprocessor and a display. 

1 8. The system configuration as claimed in claim 1 7, or 
the device as claimed in claim 1 0, wherein the self- 
describing information includes a graphical repre- 
sentation of a respective device. 

19. The system configuration as claimed in claim 18 
when dependent upon claim 17, wherein the self- 
describing information includes information regard- 
ing controls and functionality of the respective de- 
vice. 



20. The system configuration as claimed in claim 19, or 
the device as claimed in claim 10, wherein the 
means for storing includes a memory device. 

5 21. The system configuration as claimed in claim 41 

when dependent upon claim 20, wherein the self- 
describing information includes an address through 
which the system is able to obtain additional infor- 
mation about the respective device. 

10 

22. The system configuration as claimed in claim 21 , or 
the method as claimed in claim 5, wherein the self- 
describing Information includes an operating sys- 
tem driver. 

15 

23. The system configuration as claimed in claim 22 
when dependent upon claim 21 , wherein the self- 
describing information includes a user application. 

20 24. The system configuration as claimed in claim 21 
wherein the graphical interface includes graphical 
representation of the plurality of devices and con- 
nections between devices. 

25 25. The system configuration as claimed in claim 24 
wherein operation of selected devices is controlled 
through the interface by communications from the 
system to the selected devices. 

30 26. The system configuration as claimed in claim 25 
wherein the system and the plurality of devices are 
all coupled together by an IEEE 1 394 bus structure. 

27. A graphical user interface for coupling operation of 

35 devices coupled together into a network configura- 
tion, the graphical user interface comprising: 

(a) a plurality of device images each represent- 
ing a device within the network configuration; 

40 

(b) control means for displaying available con- 
trols for selected ones of the devices and con- 
trolling operation of the devices based on se- 
lected controls, wherein the plurality of device 

45 images and available controls are obtained 

from self-describing information stored within 
the devices, the self-describing information in- 
cluding an address through which the device 
image and the available controls are described. 

50 

28. The graphical user interface as claimed in claim 27 
wherein the graphical user interface is displayed on 
a computer system having a display, a memory and 
an input device. 

55 

29. The graphical user interface as claimed in claim 28 
wherein the input device is a mouse. 
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30. The graphical user interface as claimed in claim 27 
wherein the graphical user interface is displayed on 
a television. 

31 . The graphical user interface as claimed in claim 30 
wherein the input device is an infrared remote con- 
trol device. 

32. The graphical user interface as claimed in claim 27, 
or the method as claimed in claim 5, or the system 
configuration as claimed in claim 23, wherein the 
address is an internet address. 

33. The graphical user interface as claimed in claim 27, 
or the system configuration as claimed in claim 23, 
wherein the address points to a location within the 
network configuration. 

34. A system for controlling devices coupled to a bus 
structure comprising: 

(a) a bus structure configured for providing 
communications between devices; 

(b) a plurality of devices coupled to the bus 
structure for communicating across the bus 
structure, each of the plurality of devices in- 
cludes self-describing information; and 

(c) a graphical user interface for controlling op- 
eration of the plurality of devices including a 
plurality of device images each representing a 
corresponding one of the plurality of devices 
and each obtained from the self -describing in- 
formation of the corresponding device; 

(d) wherein operation of the device is controlled 
through the graphical user interface. 

35. The system as claimed in claim 34 wherein the 
graphical user interface is displayed on one of the 
devices including a microprocessor and a display. 

36. The system as claimed in claim 35 wherein the 
graphical user interface further comprises control 
means for displaying available controls for selected 
ones of the devices and controlling operation of the 
devices based on selected controls, wherein the 
available controls are obtained from the self-de- 
scribing information of the corresponding device. 

37. The system as claimed in claim 36 wherein the bus 
structure is an IEEE 1394 serial bus structure. 

38. The system as claimed in claim 34, or the user in- 
terface as claimed in claim 27, wherein the self-de- 
scribing information for a device includes a graphi- 
cal representation of the device and information re- 
garding controls and functionality of the device. 

39. The system as claimed in claim 38 when dependent 



upon claim 34, wherein the self-describing informa- 
tion further includes an internet address through 
which additional information about the device is ob- 
tained. 

5 

40. The system as claimed in claim 39 wherein the plu- 
rality of devices includes a memory for storing the 
self-describing information. 

io 41. The system as claimed in claim 40, or the system 
configuration of claim 20, or the device as claimed 
in claim 20, wherein the memory is a read-only 
memory. 



15 42. The system as claimed in claim 34 wherein the self- 
describing information further includes an address 
which points to a location within the devices coupled 
to the bus structure through which additional infor- 
mation about the device is obtained. 
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